Chutes and Ladders in Markov Chains
نویسندگان
چکیده
We investigate how the stationary distribution of a Markov chain changes when transitions from a single state are modified. In particular, adding a single directed edge to nearest neighbor random walk on a finite discrete torus in dimensions one, two, or three changes the stationary distribution linearly, logarithmically, or only locally. Related results are derived for birth and death chains approximating Bessel diffusions and for random walk on the Sierpinski gasket.
منابع مشابه
Empirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملNumerical Investigation of Pressure Load over Spillway Chutes with Vertical Curvatures
For flow conduits with mild slope and considerably large vertical curvatures the hydrostatic distribution of the pressure may be used for design proposes. However, for the spillway chutes actual pressure load over the steep slope beds with small vertical curvatures may differ from the hydrostatic pressure values. The differences in pressure load on curved bed chutes are mainly because of the ce...
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملThe Mathematics of Games of Pure Chance and Games of Pure Strategy
On the surface, there’s not much difference between the game “Chutes and Ladders” and the game of “Checkers”. Both games have simple rules and a clear criterion for victory. But these two children’s games represent two separate categories in the mathematical study of games. “Chutes and Ladders” is, of course, a game of pure chance. “Checkers” on the other hand is a game of pure strategy. The ma...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001